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(~| . We investigate optimal consumption policies in the liquidity risk model intro- 

duced in [5]. Our main result is to derive smoothness C^ results for the value 
functions of the portfolio/consumption choice problem. As an important conse- 
quence, we can prove the existence of the optimal control (portfolio/consumption 
strategy) which we characterize both in feedback form in terms of the derivatives of 
the value functions and as the solution of a second-order ODE. Finally, numerical 

.*Zl . illustrations of the behavior of optimal consumption strategies between two trading 

p^ ' dates are given. 
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1 Introduction 

We investigate the optimal consumption policies in the portfolio/consumption choice 
problem introduced in [5]. In this model, the investor has access to a market in which 
an illiquid asset (stock or fund) is traded. The price of the asset can be observed 
and trade orders can be passed only at random times given by an exogenous Poisson 
process. These times model the arrival of buy/sell orders in an illiquid market, or the 
dates on which the results of a hedge fund are published. More generally, these times 
may correspond to the dates on which the performance of certain investment projects 
becomes known. The investor is also allowed to consume (or distribute dividends to 
shareholders) continuously from the bank account and the objective is to maximize the 
expected discounted utility from consumption. The resulting optimization problem is 
a nonstandard mixed discrete/continuous time stochastic control problem, which leads 
via the dynamic programming principle to a coupled system of nonlinear integro-partial 
differential equations (IPDE). 

In [6], the authors proved that the value functions to this stochastic control problem 
are characterized as the unique viscosity solutions to the corresponding coupled IPDE. 
This characterization makes the computation of value functions possible (see [5]), but it 
does not yield the optimal consumption policies in explicit form. In this paper, we go 
beyond the viscosity property, and focus on the regularity of the value functions. Using 
arguments of (semi)concavity and the strict convexity of the Hamiltonian for the IPDE 
in connection with viscosity solutions, we show that the value functions are continuously 
differentiable. This regularity result is obtained partly by adapting a technique intro- 
duced in [3j (see also [H p. 80]) and partly by a kind of bootstrap argument that exploits 
carefully the special structure of the problem. This allows then to get the existence of an 
optimal control through a verification theorem and to produce two characterizations of 
the optimal consumption strategy: in feedback form in terms of the classical derivatives 
of the value functions, and as the solution of the Euler-Lagrange ordinary differential 
equation. We then use these characterizations to study the properties of the optimal 
consumption policies and to produce numerical examples, both in the stationary and in 
the nonstationary case. 

Portfolio optimization problems with discrete trading dates were studied by several 
authors, but the profile of optimal consumption strategies between the trading interven- 
tions has received little attention so far. Matsumoto [^ supposes that the trades succeed 
at the arrival times of an exogenous Poisson process but does not allow for consumption. 
Rogers \8\ considers an investor who can trade at discrete times and assumes that the 
consumption rate is constant between the trading dates. Finally, Rogers and Zane [9] 
allow the investor to change the consumption rate between the trading dates and derive 
the HJB equation for the value function but do not compute the optimal consumption 
policy. 

The rest of the paper is structured as follows. In section [21 we rephrase the main 
assumptions of the liquidity risk model introduced in [5], introduce the necessary defini- 
tions, and recall the viscosity characterization of the value function. Section [3] establishes 
some new properties of the value function such as the scaling relation. Section H] contains 



the main result of the paper, proving the regularity of the value function, which is used 
in section [5] to characterize and study the optimal consumption policies. Some numerical 
illustrations depict the behavior of the consumption policies between two trading dates. 
The technical proofs of some lemmas and propositions can be found in the appendix. 

2 Formulation of the problem 

Let us fix a probability space (0,9", P) endowed with a filtration F = {3^t)t>o satisfying 
the usual conditions. All stochastic processes involved in this paper are defined on the 
stochastic basis (0,9", F,P). 

We consider a model of an illiquid market where the investor can observe the positive 
stock price process S and trade only at random times {Tk}k>o with tq = < ri < . . . < 
Tfc < .... For simplicity, we assume that Sq is known and we denote by 

z, = ^^\^^'-\ k>l, 

the observed return process valued in (— l,+oo), where we set by convention Zq equal 
to some fixed constant. 

The investor may also consume continuously from the bank account (the interest rate r 
is assumed w.l.o.g. to be zero) between two trading dates. We introduce the continuous 
observation filtration G^ = {9t)t>o where: 

St =a{{Tk,Zk) : Tk < t)}, 

and the discrete observation filtration G'^ = (STfc)fc>o- Notice that St s trivial for t < ti. 
A control policy is a mixed discrete-continuous process (a, c), where a = (afc)fc>i is real- 
valued C^-predictable, i.e. ak is Sr^.i -measurable, and c = {ct)t>o is a nonnegative G'^- 
predictable process: a^ represents the amount of stock invested for the period (Tfc_i,rfc] 
after observing the stock price at time Tk-i, and q is the consumption rate at time t 
based on the available information. Starting from an initial capital x > 0, and given a 
control policy (a, c), we denote by Xf the wealth of investor at time Tk defined by: 



f^fc .^ 



r 

XI = x- ctdt+y^atZi, k>l, X^ = x. (2.1) 

•^0 ^=l 



Definition 2.1. Given an initial capital x > 0, we say that a control policy {a,c) is 
admissible, and we denote {a, c) G A{x) if 

XI > 0, a.s. \/k > 1. 

According to [5l[6], we assume the following conditions on (t^jZ^) stand in force from 
now on. 

Assumption 2.2. 



aj {Tk}k>i is the sequence of jumps of a Poisson process with intensity A. 

b) (i) For all k>l, conditionally on the interarrival time r^ — Tk-i = t £ M+, Zk is 
independent from {Ti,Zi}i^f^ and has a distribution denoted by p{t,dz). 

(a) For all t >0, the support ofp{t,dz) is 

- either an interval with interior equal to {—z_, z), z£ (0, 1] and z G (0, +oo]; 

- or it is finite equal to {—z, . . . ,z}, z G (0, 1] and z G (0, +oo). 

c) f zp{t,dz) > 0, for all t > 0, and there exist some k G M+ and b G M+, such that 

{l + z)p{t,dz) <ke^\ Vt>0. 

d) The following continuity condition is fulfilled by the measure p{t, dz) : 



lim / w{z)p{t,dz) = / w{z)p{tQ,dz), Vto > 0, 

for all measurable functions w G {—z, z) with linear growth condition. 

The following simple but important examples illustrate Assumption 12.21 

Example 2.3. S is extracted from a Black-Scholes model: dSt = bStdt + aStdWt, with 
b >0, a > 0. Then p{t,dz) is the distribution of 



Z{t) = exp 



a^ 



2 ,t + <yWt 



1, 



with support (— l,+oo) and condition c) of Assumption W^ is clearly satisfied, since in 
this case /(I + z)p{t,dz) = E [exp ((6 - a"^ /2)t + aWt)] = e''*. 

Example 2.4. Z^ is independent of the waiting times t^ — Tk-i, in which case its dis- 
tribution p{dz) does not depend on t. In particular p{dz) may be a discrete distribution 
with support {zq, . . . , Zfi} such that z = —zq G (0, 1] and Zd = z £ (0, +oo). 

We are interested in the optimal portfolio/consumption problem: 



v{x) = sup E 

{a,c)eA{x) 



-oo 

e-P^U{ct)dt 



x>0, (2.2) 



where p is a positive discount factor and U is an utility function defined on M+. We 
introduce the following assumption: 

Assumption 2.5. The function U is strictly increasing, strictly concave and C^ on 
(0, +oo) satisfying U{0) = and the Inada conditions U'{0~^) = +cxd and U'{+oo) = 0. 
Moreover, U satisfies the following growth condition: there exists 7 G (0, 1) s.t. 

U{x) < Kix'^, X > 0, (2.3) 



for some positive constant Ki. In addition, condition (4-1) of 16] is satisfied, i.e. 



p> b-/ + X 



z^ 



1 



where 7 G (0, 1) and k,b G M+ are provided by Assumption[W. 
We denote by U the convex conjugate of U, i.e. 

U{y) =sup[U{x) - xy], y>0. 

We note that U is strictly convex under our assumptions (see Theorem 26.6, Part V 
in [7]). 

Remark 2.6. In J^ \B^, U is supposed to be nondecreasing and concave while here U is 
strictly increasing and strictly convex. This assumption is not very restrictive, since the 
most common utility functions (like the ones of the CRRA type) satisfy it. 
The main reason of this new hypothesis is that it implies the strict concavity of the 
function U , which is a key assumption to get the regularity of the value functions to our 
control problem. 

Following [6], we consider the following version of the dynamic programming principe 
(in short DPP) adapted to our context 



v{x) = sup E 

{a,c)&A{x) 



i-P*U{ct)dt + e-P^^v{Xl 



n >0. 



(2.4) 



This DPP is proved rigorously in Appendix of [S]. From the expression (12. ip of the 
wealth, and the measurability conditions on the control, the above dynamic programming 
relation is written as 



v{x) = sup E 

{a,c)&Aci{x) 



' e-P^Uict)dt + e-P^'v (x- [ ' ctdt + aZi 
\ Jo 



(2.5) 



where Ad{x) is the set of pairs (a, c) with a deterministic constant, and c a deterministic 
nonnegative process s.t. a G [—x/z,x/z] and 



/ Cudu < X — l{a) i.e. ^ ~ Cudu + az > 0, Vt > 0, Vz G (— z, z), 
Jo Jo 



(2.6) 



where l{a) = max(az, —az) with the convention that max(az, —az) = az when z = +cxd 
(see Remark 2.3 of [5jll] for further details). Given a G [—x/z,x/z\, we denote by Sa(x) 
the set of deterministic nonnegative processes satisfying (|2.6|1 . Moreover under conditions 
a) and b) of Assumption 12.21 it is possible to write more explicitly the right-hand-side 
of ([23]), so that: 



v{x) 



sup 

a 6 [ 

ce ea{x) 






~(P+A)t 



U{ct) + X v(x— / Cgds + azjp{t,dz) 



dt 



(see the details in Lemma 4.1 of [6]). Let 

T) = M+xX with X = {{x,a)eR+x A -.xylia)}, 

by setting A = M if z < +00 and A = M+ if z = +00. Then, according to [SJ [6], we 
introduce the dynamic auxiliary control problem: for (f , x,a) £ T) 



v{t, X, a) = sup / e 
cgea(t,x) Jt 



^{p+X){s-t) 



U{cs) + X / v{Y^''^ + az)p{s,dz) 



ds, (2.7) 



where Ca(t,x) is the set of deterministic nonnegative processes c = {cs)s>t, such that 

/ Cudu<x-l{a), i.e. F^*'^ + az > 0, Vs > t, Vz e (z, z), 
and y*'^ is the deterministic controlled process by c € Qa{t,x): 



y; 



t,x 



Cudu, s >t. 



In particular if we consider the function g : T> 



defined by: 



g {t, x,a) := X V {x + az)p{t, dz), 



(2. 



we can rewrite (|2.7p as follows 



v{t,x,a) = sup / 
ceea(t,x) Jt 



^{p+X)(s-t) 



[C/(c,) + g(s,yf'^a)]ds. (2.9) 



We know that the original value function is related to the auxiliary optimization problem 
by: 

v{x) = sup v{0,x,a). (2.10) 

The Hamilton-Jacobi (in short HJ) equation associated to the deterministic problem 
(12. 7j) is the following Integro Partial Differential Equation (in short IPDE): 

{p + X)v{t, X, a) - ^^^ _ u ( dv{t,x,a) \ _ ^ f^^ ^ ^^^^^^^ ^^^ ^ q^ ^2.11) 



dt \ dx 

with (t, X, a) G T). In terms of the function g: 

(p + X)vit, X, a) - M!l^ _ u f M!lM ) _ g(^t, X, a) = 0, (t, x, a) G V. (2.12) 



dt 



dx 



In [6], the authors have already proved some basic properties of the value function v as 
finiteness, concavity, monotonicity and continuity on D (see Corollary 4.1 and Propo- 
sition 4.2). In particular the authors have characterized the value function through its 



dynamic programming equation by means of viscosity solutions (see Theorem 5.1). 
Our aim is to prove the smoothness of the value function v in order to get a verification 
theorem that provides the existence (and uniqueness) of the optimal control feedback. 
We first prove some further properties of the value functions {v, v) (as strict monotonic- 
ity, uniform continuity on V: see Section [3l Then we will study the regularity in the 
stationary case, i.e. when v does not depend on t. Finally we will extend the results to 
the general case. In particular we will provide some regularity properties by means of 
semiconcavity and bilateral solutions. 

It is helpful to recall the following definitions and basic results from nonsmooth anal- 
ysis concerning the generalized differentials. 

Definition 2.7. Let u be a continuous function on an open set D C 0,. For any y £ D, 
the sets 

D~u{y) = Leil: hminf <-) - ^v) - JP^^ - v) > q 

[ z&D,z^y \z — y\ 

T^+ I \ / ^ o r ^(z) -u{y) - (j),z-y) 

D u[y) = < p £ il : iimsup j j < 

I zeD,z^y \z-y\ 

are called respectively, the (Frechet) superdifferential anc? subdifferential of u aty. 

The next lemma provides a description of D'^u{x), D~u{x) in terms of test functions. 

Lemma 2.8. Let u G C{D), D cQ. open set. Then, 

L p £ D^u{y) if and only if there exists ip G C'^{D) such that Dip{y) = p and u — ip 
has a local maximum at y; 

2. p £ D~u{y) if and only if there exists ip G C^{L)) such that Dip{y) = p and u — if 
has a local minimum at y. 

Proof. See Lemma II. 1.7 of [1] for the proof. D 

As a direct consequence of Lemma [231 we can rewrite Definition 5.1 of [5] of viscosity 
solution adapted to our context, in terms of sub and superdifferentials. 



Definition 2.9. The pair of value functions {v,v) G C_|_(M_|_) x C+(23) given in (|2.2p - 
(IT71) is a viscosity solution to (l^rTU]l - ([Tn]) if: 

(i) viscosity supersolution property; v{x) > sup^^[_^/g^x/z\ ^(Oi ^i o) and for all a £ A, 

{p + X)v{t, x,a)-q- U{p) - g{t, x, a) < 0, (2.13) 

for all {q,p) £ T>^^v{t,x,a), for all {t,x,a) £ D. 

(a) viscosity subsolution property.- v{x) < sup^j^r ^./^ .^./^ v{0,x,a) and for all a G ^l, 

(p + X)v{t, x,a)-q- U{p) - g{t, x, a) > 0, (2.14) 

for all {q,p) £ Tlf^v{t,x,a), for all {t,x,a) £ D. 



The pair of functions {v,v) will be called a viscosity solution of (|2.10p - (|2.12|) if (|2.13p 
and (|2.14p hold simultaneously. 

Hence, we can reformulate the viscosity result stated in [6j. 

Proposition 2.10. Suppose Assumptions \2.^ and \2.5\ stand in force. The pair of value 
functions {v,v) defined in (I2.2p - (|2.7p is the unique viscosity solution to (|2.10l )-( l2.12p in 
the sense of Definition \2.!A 

Proof. See Theorem 5.1 of [6| for a similar proof. D 

3 Some properties of the value functions 

In this section we discuss and prove some basic properties (strict monotonicity, uniform 
continuity on T)) of the value functions {v,v). We will always suppose Assumptions 12.21 
and 12.51 throughout this section. 

By Proposition 4.2 of [6], we already know that v is nondecreasing, concave and con- 
tinuous on M+, with f(0) = 0. Moreover by Corollary 4.1 of |6], u satisfies a growth 
condition, i.e. there exists a positive constant K such that 

v{x) < Kx'^, \/x > 0. (3.1) 

Here we provide the following properties on the function v and g respectively whose 
proof can be found in Appendix: 

Proposition 3.1. The value function v is strictly increasing on M+. 

Now recall the function g given in (|2.8p . 

Lemma 3.2. The function g is: 

(i) continuous in t E M+, for every {x,a) G X; 

(a) strictly increasing in x G [1(a), +cxd), for every a G A and t E ]R-|_; 

(Hi) concave in (x, a) S X. 

If we do not assume condition d) of Assumption\2^ then the function g is only measu- 
rable in t while (ii) and (Hi) still hold. 

To conclude this section, we discuss a property of the value function v. We already know 
by Proposition 4.2 of [6], that ii is concave and continuous in (x,a) G X, and that has 
the following representation on the boundary 5X: 

/ + 00 
e-iP+^)i^-*)g{s,x,a)ds, Vi>0, y{x,a)ed1. (3.2) 

In addition, by Corollary 4.1 of [6j, we know that there exists a constant K that provides 
the following growth estimate: 

v{t,x,a)<K{e^^xy , V(t, x, a) G X), (3.3) 

with 7 G (0, 1) and b is the constant given in condition c) of Assumption 12. 2[ 



Lemma 3.3. The value function v is strictly increasing in x, for every x > l{a), given 
a€ A. 

Proof. The proof follows from the same arguments of the proof of Proposition 13.11 (see 
Appendix), using the strict monotonicity of C/ in c and of 5 in x respectively. D 

3.1 The scaling relation for power utility 

In the case where the utility function is given by 

U{x) = Kix"/, < 7 < 1, 

using the fact that c E Ca(t, x) if and only if /3c G Qf3a{t, fix) for any /5 > 0, we can easily 
deduce from the decoupled dynamic programming principle in [5] a scaling relation for 
the value function v and the auxiliary value function v: 

v{t, I3x, I3a) = P^v{t, X, a), v{(3x) = f3^v{x). 

This shows that the value function has the same form as in the Merton model (confirmed 
by the graphs in [5]) and that the optimal investment strategy consists in investing a 
fixed proportion of the wealth into the risky asset. In the case z = 00, a is nonnegative 
and we can therefore reduce the dimension of the problem and denote 

v{x)=i}ix'^, v{t,x,a) = a'^v{t,S,), ^ = x/a 

The equation satisfied by the auxiliary value function then becomes 

{p + X)v-^-U (1^) - A^i Ji^ + z)Mt, dz) = 0, 
i9i=supr^t;(0,e), 

in the nonstationary case and 

(p + \)v-U [j-^ - Ml JiC + zrp{dz) = 0, 
T?i = supC^v{C), 

in the stationary case, with 

U{y) = Kiy-\ 7 



1-7 

4 Regularity of the value functions 

In this section we investigate the regularity property of the value functions {v, v) in order 
to provide a feedback representation form for the optimal strategies. Throughout the 
whole section we will let Assumptions 12.21 and 12.51 stand in force. 

9 



4.1 The stationary case 

We start the study of the regularity with the simple case when the distribution p{t, dz) 
of the observed return process Z^, k > 1, does not depend on t, i.e. p{t, dz) = p{dz), for 
every i > 0, as in Example 12.41 Then g and v are independent of t and the IPDE (|2.12p 
reduces to the integro ordinary differential equation (in short lODE) for v{x,a): 

{p + X)v{x, a)-U (^^^^) - 9{x, a) = 0, (x, a) G X, (4.1) 



where 

/■+00 r f 

ds 



r+oo !• 

sup / e-(''+^)" U{cs) + X v{Yf + az)p{d2 
zejx) Jo . J 



CO 

v[x, a) = 

c&ea{x)Jo 

f+oo 

= sup / e-'^P+^>[U{cs)+g(Yf,a)]ds (4.2) 

ceeaix)Jo 

with 

v{x) = sup v{x,a) (4.3) 

a£[—x/z,x/z] 

All the properties of the value function v discussed in the previous section still hold for 
its restriction on the set X. In particular we have that v given in (|4.2p is concave and 
continuous on X, strictly increasing in x S [/(a),+oo) and satisfies the growth condition 

v{x,a) < Kx'^, \/{x,a) £ X, 

for some positive constant K, with 7 S (0, 1) and in particular the condition on the 
boundary dX becomes: 

r+oo 1 

v(x, a) = / e-(^+^)"5(x, a)ds = -g(x, a), V(x, a) e dX. 

Jo P + A 

We start by proving a first smoothness result for the function v. 

Proposition 4.1. The value function v defined in (|4.2p is C^ with respect to x € 
{1(a), +00), given a £ A. Moreover -—{l{a)'^,a) = +00. 

Proof. We fix a G A and let us show that v is differentiable on {1(a), +00). First we 
note that the superdifferential D^v{x, a) is nonempty since v is concave. In view of 
Proposition II. 4. 7 (c) of [T], since v is concave in re G \l{a), +00), we just have to prove 
that for a given a £ A, D^v{x, a) is a singleton for any x £ {l{a), +00). 
Suppose by contradiction that pi ^ P2 £ D^v{x,a). Without loss of generality (since 
X > 1(a)), we can assume that D^v(x,a) = [pi,P2]- Denote by coD*v(x,a) the convex 
hull of the set 

D*v(x,a) = <p : p = lim Dxv(xn,a), Xn ^ x 

I n— >+oo 

10 



Since by Proposition II. 4. 7 (a) of [T], D^v{x,a) = coD*v{x,a), there exist sequences Xn, 
Hm in M+ where v is differentiable and such that 

x= Mm Xn= hm y^, pi = hm D^v{xn,a), p2 = hm D^v{ym,a). 

n—>+oo m~^-\-oo n— ++00 »?i— >+oo 

Since condition d) of Assumption 12.21 and Assumption 12.51 hold, by Theorem 5.1 of [6], 
the pair of value functions {v,v) is a viscosity solution to (|4.1I) - (I4.3|) : then by Proposition 
1.9 (a) of [H, 

(p + X)v{xn, a) -U [D^vixn, a)) - g{xn, a) = 
[p + X)viym, a) -U {D^v{ym,a)) - g{ym, a) = 0; 
by continuity this yields 

{p + X)v{x,a)-U{pi)-g{x,a)=0 (4.4) 

(p + X)v{x, a)-U {p2) - g{x, a) = 0. (4.5) 

Now let p = rjpi + (1 — r/)p2, for rj G (0, 1). Since p € (^1,^2) C D^v{x,a), we have by 
the viscosity supersolution property of v : 

(p + X)v{x, a) — U{p) — g{x, a) < 0, 

so by (Ii^ - (li3]) . we get 

Uip) > 7]Uipi) + (1 - r])U{p2). (4.6) 

On the other hand, by strict convexity of U, we get 

u(p) = u{npi + (1 - v)p2) < vU{pi) + (1 - v)u{p2), 

contradicting (|4.6p . Hence v is differentiable at any x G {1(a), +00). Notice from (14. ip 
that for all a E A, 7— is continuous in 4^. Now we prove the last statement. If we get 

(JX 

X = l{a) in (1121), then 

v{l{a),a) = — — -5(/(a),a). 
p + X 

Now we send x -^ l{a) in (|4.ip (this is possible since v and g are continuous in a; G 
[1(a), +00) and since — is monotone in x) and we obtain 

CJJb 

(p + A)^(/(a)+,a)-C7(^^i^^^)-5(/(a)+,a)=0. 
Comparing the last formulas, we obtain 

\ OX J ox 

U 



^This follows also from Proposition 3.3.4 (e), pages 55-56 of [2]. 
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Before the final result we provide the following lemma. 

Lemma 4.2. Let v and v be the value functions given in (|2.2p and (14. 2p respectively. 
Then, given any a; > and calling Ux a maximum point of the problem (|4.3p . we have 

D+v{x)<ZD+v{x,ax). (4.8) 

Proof. Let x > 0. Since v is concave we have 

D^v{x) = {p : v{x + h) — v{x) < ph, V/i s.t. x + h > 0} , 

Since v is concave we have D^v{x) / 0. Let p G D~^v{x). We have to prove that 

v{x + h,ax) — v{x,ax) <ph, (4.9) 

for every h such that x + h> l{ax)- We first observe that 

v{x + h, Ux+h) — v{x, ax) = v{x + h) — v{x) < ph, (4-10) 

for every h such that x + /i > (here a^ and o^^+zi are optimal for v{x) and v{x + h) 
respectively). 

Now call I{x) = — |, I and observe that, for < xi < 0:2 we have C I{xi) C I{x2)- 

So if /i > we have that a^^ E I{x + /i), ^(x + h, ax) is well defined and 

v{x + h,ax) <v{x + h,ax+h) (4-11) 

which, together with (I4.10p . implies (|4.9|) for h > 0. Now if x = Z(aa;) there is nothing 
more to prove. If x > l{ax) take h < such that x + h > l{ax). For such h we have 
Oa; G I(x + /i) so we still have (14. lip and so the claim as for the case /i > 0. Hence 
p £ D+v{x,ax). □ 

Now we are ready to prove the final regularity result for the stationary case. 

Theorem 4.3. Let v, v be the value functions given in (|2.2|) and (|2.7|) respectively. 
Then: 

• f E C^(0,+cxd) and any maximum point in (|4.3|) is internal for every x > 0; 
moreover t;'(0+) = +cxd; 

• for every a £ A we have 'u(-,a) E C^(/(a), +00). Finally — — (/(a)^,a) = +00. 

ax 

Proof. Since f is concave then L>^f (x) is nonempty at every x > 0. This implies, by 
(14.8(1 . that also D^v{x,ax) is nonempty for every x > 0. Since, by (|4.7I) . — (/(a)"'",a) = 

+00 (which implies D^v{l{a),a) = 0) we get that it must be x > l{ax) and so any 
maximum point in (I4.3|l is internal. Moreover since, given o E ^ we have that v is C^ in 
X E (/(a), +00) then the superdifferential is a single point and so from (|4.8p also D^v{x) 
ia single point, which implies the wanted regularity of v. The statement u'(0"'") = +00 
follows simply observing that v{x) > 'O(x,0), v{Q) = "0(0,0) = 0, and from (|4.7p for a 

= 0. Finally v(-,a) E C'^ilia), +00) follows from (14. ip and --(/(a)"*", a) = +00 from 
Proposition 14.11 D 
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4.2 The nonstationary case 

In this subsection we study the regularity of the value function v in the general case 
where the distribution p{t, dz) may depend on time. With respect to the stationary 
case, the value function v is in general not concave in both time-space variables, and 
we cannot apply directly arguments as in Proposition 14.11 Actually, we shall prove the 
regularity of the value function v as well as in the stationary case, by means of (locally) 
semiconcave functions. 
First, we recall the concept of semiconcavity. Let 5 be a subset of il. 

Definition 4.4. We say that a function u : S ^^ E. is semiconcave if there exists a 
nondecreasing upper semicontinuous function uj : M+ -^ M-(_ such that limp^o+ ^{p) =0 
and 

r]u{xi) + (1 - ri)u{x2) - ti(??xi + (1 - rj)x2) < r]{l - ??)|xi - X2|w(|xi - X2I), (4.12) 

for any pair xi,X2 such that the segment [a;i,a;2] is contained in S and for rj G [0, 1]. In 
particular we call locally semiconcave a function which is semiconcave on every compact 
subset of its domain of definition. 

Clearly, a concave function is also semiconcave. An important example of semiconcave 
functions is given by the smooth ones. 

Proposition 4.5. Let u £ C^{A), with A open. Then both u and —u are locally semi- 
concave in A with modulus equal to the modulus of continuity of Du. 

Proof. See Proposition 2.1.2 of |2] for the proof. D 

Remark 4.6. We should stress that the superdifferential of a locally semiconcave function 
is nonempty, since all the properties of superdifferential hold even locally. 

We introduce an additional assumption on the measure p{t,dz): 

Assumption 4.7. for every a £ A — {0} , the map 

(t,x)^A/^x + a.)p(t,d.) 

is locally semiconcave for {t, x) G (0, +00) x (/(a), +00), and for all measurable continuous 
functions w onM. with linear growth condition. 

Remark 4.8. Since it is not trivial to check the validity of Assumption \J71[ we give some 
conditions the guarantee it. First of all, we exclude the case a = from Assumption \4 -71 
since in this case we have, for every {t,x) G M-|- x [1(a), -|-cxd) 

g{t,x) = Xv{x) 

so we are in the stationary case and we already know from the previous section that v is 
C^ . Now, when a ^ 0, we set the new variable y = x + az = hx{z) and call fi{t,x;dy) 
the measure {h^ o p){t,dz). The measure /x has the following support: 
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1. {x — az, +cxd), if z = +00, and a > 0; 

2. {x — az, X + az), if z < +00 and a > 

3. {x + az, X — az), if z < +cxd and a < 0; 

4- {x — az, . . . ,x + az}, if the support of p is finite and a > (in this case z < +cxd); 
5. {x + az, . . . ,x — az}, if the support of p is finite and a < (in this case z < +00). 
Now Assumption \4-7\ can be written as: the function g^ given by 

{t,x) 1 — > A / w{y)fi{t,x;dy) 



is locally semiconcave for (t, x) G (0, +00) x {l{a), +00), and for all measurable continuous 
functions w on^ with linear growth condition. 

In this form, it is easier to find conditions that guarantee the validity of this assumption 
in terms of the regularity of n. For example, if we assume the measure p{t,dz) has a 
density f{t,z), the integral 

w{x + az)f{t, z)dz 



by the above change of variable is rewritten as: 

Now, by Proposition \4-5[ the local semiconcavity of g^ in the interior (0, +cxd) x {l{a), +cxd) 
of its domain follows from its continuous differentiability. 

Let us give a condition that guarantees that g^ is C^ in the case d // the density f 
is continuously differentiable and suitable integrability conditions are satisfied, then we 
have: for every a > 0, 

dgUt,x) I f+°° df fv-x 



dt 



a 



r+°° Qf / y - x\ 



dg^it,x) 1 /■+°° df fv-x\^ 1 



dx 



1 /■+°° df f y - x\ 1 



for {t,x) E (0, +00) X {1(a), +00). From the above expressions, it is easy to check that 
we can derive the continuous differentiability from the following assumptions: 

• the density f is continuous and for each a £ A, the generalized integral 

r^(l + \y\)f(t,y^^)dy 

J x—az \ ^ J 

converges for every {t,x) G (0, +00) x {1(a), +00); 
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df df 
the partial derivatives -—, — — are continuous and satisfy respectively the following 

at ox 
integrability conditions: for each a ^ A, 



"■"n^i \^^U, y-'^\A 

x—az 



dt 



a 



converges uniformly with respect to t £ T, for any compact set T of (0, +00), for 
every x G {1(a), +00), and 



x—az 



dx 



a 



converges uniformly with respect to x £ K, for any compact set K of {l{a), +00), 
for every t G (0, +00). 

Let us check the above assumptions in the Black-Scholes model, introduced in Example 
\2.3[ . We recall that the dynamics of S is given by dSt = bStdt + aStdWt, with b > 0, 
a > 0, so that p{t, dz) is the distribution of 



Z(t) = exp 



b-'^]t + aWt 



1, 



with support (— l,+oo). Then, since S has a lognormal distribution, the density fz is 
given by: 



fz{t,z) 



aV27ri{z + 1) 



exp 



ln{z + l)-[b-^)t 
2^t 



dfz dfz 
We compute the partial derivatives — ;- — , -;- — and we get: 

ot oz 



dfz{t,z) 
dt 

dfz{t,z) 



2aV2TTt{z + I) 
1 



(ln(z + l)-(ft-i^)t)^ 



(ln(z + l)-((,-2^)t)^ 



1 1 



b 1 



+ ^r-\n\z + l)-^ + 



t aH 



a^ 



1 w 1^ ^ 3 



aH 



dz aV2^{z + 1)2 

Hence it is not difficult to check that the assumptions described above are satisfied. 

We start by proving a smoothness property for v. 

Proposition 4.9. Suppose that Assumption \4. 7| is satisfied. Then the value function v 
defined in (|2.7I) belongs to C^ ([0,+oo) x {1(a), +00)), given a £ A. Moreover 



dv{t,l{a)^,a) 
dx 



+00, for every t > 0. 



(4.13) 
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Proof. We fix a G A and let us show that v is differentiable at any (f , x) £ (0, +00) x 
{1(a), +00). When a = 0, as we noted at the beginning of Remark 14.81 v is independent 
of t and C^ in x thanks to the results of Section 5. Take then o / 0. First, we notice 
from Assumption 14.71 that g is (locally) semiconcave in {t,x) S (0,+oo) x {1(a), +00). 
Together with the concavity of U, this shows that v is (locally) semiconcave in (t, x) G 
(0, +cxd) X (1(a), +cxd). Indeed, if we set r = s — i we can rewrite (|2.9|) as follows: 



/•+00 
v(t, X, a) = sup / e-(''+^)^ [U(cr) +g{r + t, y^°'^, a)] dr 

P+00 
sup / e-(^+^)M^(cr)+5(r- + t,>7,a)]dr. 
zea(x)Jo 



c£eaix)Jo 

For every (t,x) G M+ x (1(a), +00), c £ Qa(x), we put 

r+00 
J(t, x, a; c) := / e^^f^^^'' [U(cr) +g(r + t, y;=, a)] dr. 
Jo 

Let ti,t2 > 0, with ti < ^2, a;i,X2 S (^(a),+oo), with xi < X2. By setting t^ = 
rjti + (1 — i])t2, Xfj = rjxi + (1 — T^)x2, we have for all (t,x) S (0, +00) x (1(a), +00) 

'qJ(ti,xi,a;ci) + (1 - i])J(t2,X2,a;c2) - J(t,,,x^,a; c^) 
/■+00 
= / e-(P+A)r [,,[/(ci(r)) + (1 - v)U(c2(r)) - U(c^(r))] dr 
Jo 

r+oo 
+ / e-(''+^)^ [r?5 (r + ti,y,"Sa) + (1 - r?)^ (r + t2,l;"^a) - 5 (r + t,„lf ^a)] dr 
Jo 

r+oo 

< / e-(^+^)'^ [w (r + ti, y,"S a) + (1 - v)9 (r + ^2, Y,^',a) - g (r + t^, Yr^'^a)] dr, 
Jo 



by using the strict concavity of U. By the semiconcavity of the function g and by taking 
the supremum of the functional J over the set Sa(x), we can derive the semiconcavity 
of V for (t, x) G (0, +00) X (1(a), +cxd). Hence Df^v(t, x, a) 7^ 0, so we have just to prove 
that Df^v(t,x,a) is a singleton, for each (t,x) € (0, +00) x (1(a), +00). By using the 
same arguments of Proposition 14.11 we get the Frechet differentiability. 

(dv dv 
— , — — 

for (t,x) G (0, +00) X (1(a), +00), given a G A. Then the value function v defined in 
(1271) belongs to C^((0,+oo) x (1(a), +00)), given a E ^l. 

To get that v(-,-,a) G C^([0, +00) x (1(a), +00)) it is enough to extend the datum g (and 
so the value function v) to small negative times and repeat the above arguments. 

Now we prove (I4.13|) by using similar arguments to the ones to check the final state- 
ment of Proposition 14.11 If we get x = 1(a) in (|2.9p . then 



-00 



v(t,l(a),a)= e~^f'+^^^'-^'>g(s,l(a),a)ds, Vt > 0. 
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Now we send x — > l{a) in (I2.12p (this is possible since v, g and — are continuous in 
X G [/(o), +00 Jj and since — is monotone in x) and we obtain 

(p + A)^ {t, l{a)+,a) ^'^^^ ' - U I ^ '^y M - 5 (i, /(a)+, a) = 0. 

Comparing the last formulas, we obtain 

\ OX J ox 

□ 

Lemma 4.10. Suppose that Assumption \4-7\ is satisfied. Let v and v be the value func- 
tions given in (|2.2p and (12.7(1 respectively. Then, given any x > and calling Qx a 
maximum point of the problem (|2.10p . we have 

D+v{x) QD^v{0,x,ax). 

Proof. It works exactly as well as in the stationary case. D 

We come now to the final regularity result for the nonstationary case. 

Theorem 4.11. Suppose that Assumption"^/ is satisfied. Letv, v be the value functions 



given in (|2.2p and (12. 7p respectively. Then: 

• V € C^(0,+oo) and any maximum point in (|4.3|) is internal for every x > 0; 
moreover v'{0^) = +cxd; 

• for every a G A we have v{-, ■, a) G C^ ([0, +cxd) x {1(a), +00)); finally 

dv(t,l(a)~^,a) _ , ^ ^ 

— ^ = +00, for every t > 0. 

ox 

Proof. It follows as in the stationary case. □ 



Remark 4.12. We should stress that even if the semiconcavity assumption \4'A does 
not hold, the continuous differentiability in x of the function g given in (|2.8p is still 
guaranteed in the case of power utility and when the density p{t, dz) is supposed to be 
"sufficiently regular" in x. 

5 Existence and characterization of optimal strategies 

Let Assumptions 12.21 12.51 and 14.71 stand in force throughout this section. 



^By Remark 4.4 of [6J we already know that v is difFerentiable in t on the boundary and in particular 
the continuity follows from l|2.7p . 
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5.1 Feedback representation form of the optimal strategies 

The following result guarantees the existence and uniqueness of the optimal control for 
the auxiliary problem (12. 7|) . 

Proposition 5.1. Let v be the value function given in (|2.7p . Fix a G A. We denote 
by I = {U')^^ : (0,+cxd) -^ (0,+cxd) the inverse function of the derivative U' and we 
consider the following nonnegative measurable function for each a G A: 



... . 'dv{t,x,a] , 

c{t,x,a) = I = argmax 

^ ' dx J c>o 



■ dv{t,x,a) 

U [c) — c- 



dx 



(5.1) 



Let {t,x) G M-|_ X [1(a), +oo). There exists a unique optimal couple {c.,Y.) at {t,x) for 
the auxiliary problem introduced in (|2.7|) given by: 

Cs := c{s,Ys,a), s >t, (5.2) 

where Yg, s > t, is the unique solution of 

Y^ = -c{s,Ys,a), s>t , ■ 

Yt = X. ^^■'^^ 

Note that the triplet {s,Ys,a) G T), for s >t. 

Proof. A rigorous proof can be found in Appendix. D 

Under suitable assumptions, we state the verification theorem for the coupled IPDE 
(I2.10p - (|2.12|) . which provides the optimal control in feedback form. 

Theorem 5.2. There exists an optimal control policy {a*,c*) given by 

Ofc+i = arg ^max ^^v{0,X^,a), k>0 (5.4) 

A<a<— Sl 

z — — Z_ 

.(fc) 



4 = C[t- Tk, i^t , Ofe+l j , Tk <t < Tfc+i, (5.5) 

where X^ is the wealth investor at time Tjr. given in (|2.ip and Y. is the unique solution 

of 

y; = -c(s, Ys, a^+i), Tfc < s < Tfc+1 

^Tfc = XI. 

Proof. Thanks to Proposition 15.11 we can prove the existence of an optimal feedback 
control {a*,c*) for v{x). 

Given x > 0, consider the control policy {a*,c*) defined by (|5.4p - (|5.5p . By construction, 
the associated wealth process satisfies for all /c > 0, 

= YJ^l+al+,Zk+i 

> l{a*k+i) + Ofc+i^fc+i > 0, a.s. 
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since — z < Zk+i < z a.s. Hence, {a*,c*) G -^{x), i.e. {a*,c*) is admissible. By 
Proposition 15.11 and definition of al_^^ and v, we have: 






,-(p+A)(s-Tfc) 



Tfc 



U{cs{n,YJ'^\al^,))+g\{s-Tj,,YJ''\al_,,)d 



E 



Tk + l 



-Pis-Tk) 



U{c*)ds + e 



-(P+-'^)(Tfc + l-Tfc) 



K^fc\i: 



Tfc 



JTk 



by Lemma 4.1 of [6]. By iterating these relations for all k, and using the law of conditional 
expectations, we obtain 



v[x) 



E 



e-P'U{cl)ds + e'P^"v{X, 



for all n. By sending n to infinity, we get: 



vix) = E 



which provides the required result. 



■ f-+oo 

/ e-P'U{cl)ds 
Jo 



U 



Remark 5.3. In the stationary case the Assumption \4'if\ is not needed to prove the 
existence of feedback controls, as it is automatically satisfied. Moreover we note that in 
the stationary case there is not an explicit dependence on t of the optimal control in 
feedback form. Indeed, it is given by the couple {a*,c*), where 



a 



fc+i = arg max v{X^,a), k>0 



xf xi 



c[Y, 



(k) 



a 



t !"A;+1 ) ) 



Tk <t < Tfc+i, 



and in particular c is the restriction on the set X of the nonnegative measurable functions 
introduced in (15. ip . i.e. 



c{x, a) = I 



dv{x, a) 
dx 



arg max 
c>0 



f/(c) 



dv{x., a) 
dx 



(5.7) 



Remark 5.4. It is not trivial to state the uniqueness of the strategy {a*,c*), whose 
existence is proved in Theorem \5.S\ . We can only say that, if we prove that a* is unique, 
then also c* will be unique thanks to Theorem \5.'A The problem is strictly related to the 
behavior of the functions v and g that are ex ante not strictly concave in a. 

Remark 5.5. >From the feedback representation given in Proposition \5.1\ and in The- 
orem 15.4 it follows that the function v is strictly concave and that the functions g and 
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V are strictly concave in x. Indeed, given two points xi,X2 > l{a) and calling c\,C2 the 
corresponding optimal consumption paths for the original problem, we have, forr] G (0, 1), 

v{r]Xi + (1 - ri)x2) - rjv{xi) - (1 - r])v{x2) 

(5.8) 



> E 



e-P' [f/(r/cL + (1 - 7?)cL) - U{r^cl) - (1 - 7?)C/(cL)] ds 





Thanks to the feedback formulas, the two consumption rates c^,C2 must be different in a 
set of positive measure (dt x dF) so the right-hand-side of (15. 8p is strictly positive and 
we get strict concavity of v. Then the strict concavity of g in x follows directly from its 
definition whereas the strict concavity of v in x follows from, the IPDE (I2.12P . 

5.2 Consumption policy between two trading dates 

>Prom the regularity properties discussed in SubsectionHJ we can deduce more properties 
of the optimal consumption policy. We discuss them separately for the stationary and 
the nonstationary case. 

5.2.1 The stationary case 

Proposition 5.6. Let a ^ A and {t,x) £ M^ x [1(a), +oo). Let {c.,Y.) be the optimal 
couple for the auxiliary problem starting at (t, x). If x = l{a), then c = 0,soY = 1(a). If 
x > 1(a) then c is continuous, strictly positive and strictly decreasing while Y is strictly 
decreasing and strictly convex. Moreover limf^+oo Q = and limf^+oo Yf = 1(a). 

Proof. The first statement follows immediately from the setting of the auxiliary pro- 
blem. We prove the second statement. Indeed, by (|5.7|) and Remark 15.51 it follows that 
the function c is strictly increasing and continuous in x. Since q = c(Yt,a) and Y is 
continuous and decreasing, then also c is decreasing. Moreover, q > for every t: indeed 
if it becomes zero in finite time then the associated costate would have a singularity and 
this is impossible: see the proof of Proposition 15.101 in the non stationary case. The 
strict positivity of c implies that Y is strictly decreasing and so, by (|5.7|) that c is strictly 
decreasing and Y is strictly convex. 

Finally, by the definition of the auxiliary control problem, j^ Cgds < x — 1(a) which 
implies the limit of c. If the limit of ? is xi > 1(a), we get from the feedback formula 
(lOl that 

lim ct = c(xi,a) > 

t— »+oo 

which is impossible. D 

The regularity results for c then allow to deduce an autonomous equation for the optimal 
consumption policy between two trading dates. 

Proposition 5.7. Suppose that U S C^((0, oo)) with U"(x) < for all x. Then the 
wealth process Y between two trading dates is twice differentiable and satisfies the second- 
order ODE 

d^Yt g'(Yt)-(p + X)U'(ct) dYt 

-d^ = iFW) ' ^* = -^- ('■') 
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Proof. Differentiating equations (I4.1|l and (|5.7|) with respect to x and (|5.3p (restricted 
on X) with respect to t, we obtain 

d^Yt _ dc{Yt,a) 
dt2 ax ""*' 

dc{x,a) , f dv{x,a)\ d'^v{x,a) 1 d'^v{x,a) 



dx \ dx J dx'^ U"{c{x,a)) dx"^ 

dv{x,a) ~^, / dv{x,a) \ d^v{x,a) ^ff ^ q 
5x \ dx J dx^ dx 

Using the equality U'{U'{y)) = —y, the last equation can be rewritten in terms of c: 

Assembling all the pieces together, we obtain the final result (|5.9p . D 

The equation (|5.9p is a second-order ODE similar to equations of theoretical mechanics 
(second Newton's law), and it should be solved on the interval [0, +00) with the boundary 
conditions Yq = x and Y^o = l{a) (which corresponds to resetting the time to zero after 
the last trading date). Solving this equation does not require the auxiliary value function 
V but only the original value function v, which, in the case of power utility, can be found 
from the scaling relation. 

The case of power utility. In the case of power utility function U{x) = Kix'^ , the 
equation (|5.9p takes the form 



^ = fi^c. - ^^,^1-^cr .m n = x, Y^ = Ka). (5.10) 

In this case, one can deduce a simple exponential lower bound on the integrated con- 
sumption, corresponding to the solution of (|5.10|) in the case <? = 0. 

Proposition 5.8. The process Y solution of (jS.lOp satisfies 

where Y^ is the solution of (|5.10l) with g = 0, given explicitly by 

Y^^ = x-{x-l{a)){l-e~^=^). (5.11) 

The condition g = means that the value function of the investor resets to zero (the 
investor dies) at a random future time. In this case it is clear that a rational agent 
will consume faster than in the case where more interesting investment opportunities are 
available. The typical shape of optimal consumption policies is plotted in Figure [H 
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Proof. The equation (jS.lOp can be rewritten as 

dct p + X 



at 1 — 7 

>Prom Gronwall's inequality we then find 

_£±A(t_s) 

Y,<Y.-'-^^{l-e-^^^-\ t>s. 
p + X 

The terminal condition Yoo = l{o) implies 

l{a) <Yt — -— . 

p + X 

On the other hand, the solution of the problem without investment opportunities satisfies 

.0 cO(l-7) 



l{a) = Vr 



P + X 



Therefore, 



and 



Since Yq = Yq = x, another application of Gronwall's inequality shows that Y^' < Yt for 
all t. D 



5.2.2 The nonstationary case 

In this case the regularity results for the optimal strategies are weaker and more difficult 
to prove. 

Proposition 5.9. Let a e A and {t,x) € M+ x [1(a), +qo). Let {c.,Y.) be the optimal 
couple for the auxiliary problem starting at {t,x). If x = 1(a), then c = 0, so Y = 1(a). 
If X > 1(a) then c is continuous, strictly positive and limi^+oo Q = 0. 

Proof. The proof is the same as in the stationary case. D 

Note that, with respect to the stationary case here we do not have monotonicity of the 
optimal consumption since the behavior of v in the time variable is not known. 
Moreover here the limiting property for Y is proved only under the assumption of twice 
continuous differentiability of U, as given below. 

As in the stationary case we can deduce an autonomous equation for the optimal wealth 
process between two trading dates. However, since we have weaker regularity results the 
proof is different and makes use of the maximum principle. 
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Exp. bound 
Optimal wealth 




Consumption corresponding to YO 
Optimal consumption 



0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0 




0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0 



Figure 1: Left: typical profile of the optimal wealth process Yf and the exponential lower 
bound given by the proposition I5.8[ Right: the corresponding consumption strategies. 
In the presence of investment opportunities, the agent first consumes slowly but if the 
investment opportunity does not appear, the agent eventually "gets disappointed" and 
starts to consume fast. 

Proposition 5.10. Suppose that U G C^((0, oo)) with U"{x) < for all x. Then the 
optimal wealth process Ys between two trading dates is twice differentiable, it satisfies the 
second-order ODE 



ds2 



da(s,Ys) 
dx 



ip + X)U'ics 



U"{Cs) 



' ds' 



Yt 



(5.12) 



and limt^+oo Yt = l{a). 



Proof. We cannot differentiate equations (I2.12p and (|5.ip with respect to x as in the 
stationary case as we do not know if u is C^. Then we follow a different approach. We 
use the maximum principle contained in Theorem 12 p 234 of |10| . Such theorem concerns 
problems with endpoint constraints but without state constraints. Due to the positivity 
of the consumption, our auxiliary problem (|2.7|) can be easily rephrased substituting the 
state constraint Ys > l{a),\/s > t with the endpoint constraint lim^^+oo ^s > ^o)- So 
we can apply the above quoted theorem that, applied to our case, states the following: 

Assume that g{-,-) and q^' are continuous. Given an optimal couple {Y.,c.) with c 
continuous there exists a function p{-) G C^(i,+oo;M) such that: 



p(-) is a solution of the equation 



p[s) 



(P + A)p(s) 



dg{s,Z) , 
dx 



U'{cs) = p{s) <-^ Cs = I{p{s)) for every s > t; 

liniT^+oo e^P'^ '^^ 'p{T) = 0, for every t < s <T (transversality condition) . 
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Since we already know (from Proposition IS.ip that there exists a unique optimal couple 
{Y.,c.) and that c is continuous (see of Proposition 15.91) the above statements apply. 
Then we get that Cg > for every s > t, that c is everywhere differentiable and that 



'^'' I'ip{s))p'is) ^ 



ds '"' "" ' ' U"(c, 



( , WTT'i- \ ^9{s,Ys 



dx 



which gives the claim recalling that Cg = — . 

_ ds 

Concerning the limiting property of Y we argue by contradiction. Let lims_»+oo Yg = 

xi > l{a). We have then, by the definition of g, for every s > t, 

dgis,Ys) dg{s,xi) , u w ^ , 

-^^ < -^^ < Xv {X, - l{a)) < +00. 

Then from the costate equation we get that, for t < s < T < +00 

p{s) < e(''+^)(^-^)p(r) + / e^P+^^^'-^hv'{xi - l{a))dr 

< e(''+^)(^-^)p(T) + ^v'ixi - l{a)){l - e-^P+^^^) 
p + X 

Using that \miT^+<yo&^^^'^'^''^'^'p{T) = we get a uniform bound for p{s). This is a 
contradiction as lim^-^+oo p(s) = linis_^+oo U'{cs) = +00. D 

The equation (I5.12p is a second-order ODE similar to equations of theoretical mechanics 
(second Newton's law), and it should be solved on the interval [0, +00) with the boundary 
conditions Yq = x and Yqo = K^^) (which corresponds to resetting the time to zero after 
the last trading date). Solving this equation does not require the auxiliary value function 
V but only the original value function v, which, in the case of power utility, can be found 
from the scaling relation. 

Remark 5.11. The Maximum Principle used in the above proof holds once we know that 



dgj;-) 



g{-,-) and q^ ' are continuous. As observed in Remark \4.1S\ this is true also 



m cases 



when the semiconcavity assumption \4 ■ 7| may fail (notably in the case of power utility and 
in the case of 'regular' density). So, also in such cases the Maximum Principle could 
be used to get information about the optimal strategies. Clearly, without knowing the 
regularity of the value function v such information would be much less satisfactory. 

The case of power utility. In the case of power utility function, the equation (|5.12p 
can again be simplified: 



d'^Yt _p + X X^icf'^ 



dt2 1-7^^ i^i(l-7) 



f(Yt + azy-^t, dz), Yo = x, Foo = l{a). 



Because the second term in the right-hand side is still positive, the exponential bound 
of Proposition 15.81 can be established in exactly the same way as in the stationary case. 
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Figure 2: Optimal wealth (left) and consumption policy (right) for the probability dis- 
tribution extracted from the Black-Scholes model (solid line) and from the stationary 
model having the same distribution as the Black-Scholes model in 3 years' time (dashed 
line) . 

Figure [2] depicts the optimal wealth process and the optimal consumption policy for the 
probability distribution p(t, dz) extracted from the Black-Scholes model with the same 
parameter values as in |5j: drift b = 0.4, volatility cr = 1, discount factor p = 0.2, 
intensity A = 2 and risk aversion coefficient 7 = 0.5. We see that at least qualitatively, 
the consumption profile is similar to the one observed in the stationary model, with 
exponential decay. For comparison, we also plot the wealth and consumption policy for 
the stationary model with distribution corresponding to the Black-Scholes model in 3 
years' time. In this case the agent consumes at a slower rate than in the nonstationary 
model. The explanation is that for the parameter values we chose, 3 years is a very 
long time horizon, because all the consumption happens, essentially, during the first 2 
years after trading. During this period (first 2 years) the stationary model offers better 
investment opportunities, which explains the slower consumption rate. 

A Appendix : Technical proofs 



Proof of Proposition 13. IL We suppose by contradiction that v is not strictly increa- 
sing on M+ This means that it is definitely constant on M+ from a certain x on, since v 
is concave. Then we fix x S M_|_ such that v{x) = B £ IR^., for all x > x. Take e > and 
a pair {a'^,c^) e-optimal at x. This means that {a'^,d^) G ■A(x), i.e. 



-Xi, 



/ cldt + V alZi > 0, VA; > 1, X^ 
Jo 
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and 



B = v{x) < E 



■ /•+00 

/ e-P'Uicl)dt 
Jo 



+ e. 



Now we choose x > x + 1. Then we have v{x) = v{x) = B. We consider the control 
pohcy (a*^, c), where q = Cj +I[o,i](i), for all i > 0. Hence given x > 0, we have for every 
fc> 1, 



Xl = x- 



> X 



/ ctdt + ^atZi = i- c^dt- (1 Arfc)+ Va^Zi 

Jo .^, Jo ,^1 

/ c^dt + Va^Z, >0, 



with Xq = X, so (a'^,c) G A{x). Moreover we have: 



v{i) >E 



>E 



'{ct)dt 


= E 


.JO 


e-P^U 


yo 


P'Uict 


)dt 


+ E 



/ e-P^U{cl + l)dt +E / e-''*C/(q^)dt 



e-^'f/(c^)dt 



v{x) = B, 



since C/ is strictly increasing. But this is not possible, since we have assumed v constant 
from x on. Hence the statement is proved. 



D 



Proof of Proposition 13. 2L 



(i) The continuity comes from condition d) of Assumption 12.21 If d) does not hold, 
measurability follows from condition b) of Assumption 12.21 

(ii) The function g is strictly increasing in x G [/(a), +oo) since v is strictly increasing 
by Proposition 13.11 

(iii) This property is a direct consequence of concavity of v. Indeed, given t > 0, 
consider (x^,o^) = (rjxi + (1 — ri)x2,rjai + (1 — rj)a2), with rj G (0,1), xi > 
l{ai),X2 > l{a2)- First of all, x^ > /(a,,) thanks to the convexity of the function /. 
Since v is concave, we have for every t > 0: 



g{t, Xn,ari) = X / v (r/xi + (1 - r/)x2 + ijaiz + (1 - r])a2z) p{t, dz) 

> Xr] V {xi + aiz) p{t, dz) + A(l - r/) / v {x2 + a2z) p{t, dz) 
= Xr)g{t, xi, ai) + A(l - r])g{t, X2, 02). 
This provides the result. 



D 
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Proof of Proposition 15. IL In order to prove Proposition 15.11 we need the following 
preliminary result: 

Lemma A.l. Let v be the value function given in (12. 7|) . Fix a E A. Assume the 
fallowings: 

(i) v{-,-,a) G C^R+ X (/(a),+cx))); 

dv(t,l(a)^ ,a) 
(ii) = +00, for every t G 1k+; 



(Hi) V is a classical solution of the HJ equation (I2.12p satisfying the growth condition 
(13. 3p with representation (13. 2|) on the boundary. 



Given x G [1(a), +oo) and t > 0, for every couple (c, Y) admissible at [t, x) for s > t, we 
have the following identity: for T > t 



'(p+A)T^ (j.^ Y^^ a) _ e-(p+A)t^)(i^ x^ a) 



'(P+A)s 



e '■''■'■'" [U{cs) +g{s,Ys, a)] ds 



M, ' 



-ip+X)s 



, , dv{s,Ys,a) ~ /dv{s,Ys,a) 
U[Cs) - Cs LI 



dx 



dx 



(A.l) 



ds, 



with the agreement that 

dv{t,l{a),a) dv{t,l{a)^,a) 



dx 
IfT goes to +oo 

v{t,x,a) = 



dx 



^{p+X){s-t) 



+00, so that U 



dv{s,l{a), a) 
dx 



0. 



-(p+X)(s-t) 



U{Cs 



U{cs)+g{s,Ys,a) 

_ dv{s,Ys,a) _ 
dx 



ds 



U 



dv{s,Ys,a) 
dx 



(A.2) 



ds. 



Furthermore, an admissible couple (c, Y) is optimal at (t, x) if and only if 



U 



dv{s,Ys,a] 
dx 



dv{s,Y„a) 
U[Cs) — Cs ^ , tor a.e. s >t 



dx 



such that Yg > l{a) and Cs = otherwise. 



Proof. Let {c,Y) be an admissible couple for the auxiliary problem such that Yg > l{a), 
for every s >t. By applying standard differential calculus to e~'^f^^'^v{s, Ys, a) between 
s = t and s = T, we have: 



<P+>^)T^T,YT,a) - e-^P+^^'v{t,x,a) 



-{p+A)s 



dv{s,Ys,a) , \^-^f V \ dv{s,Ys,a 

- {p + X)v{s,Ys,a) -Cs- 



dt 



-{p+\)s 



'dv{s,Ys,a] . f V \ 
dx ' ~ ^^^' '^ ~ '^' 



dx 
dv{s, Ys, a 



ds 



dx 



ds, 
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where in the last equation we have used the fact that v satisfies (|2.12|) . This can be 
easily rewritten as (lA.ip by adding and subtracting U{cs) in the integrand. Now, from 
the growth condition (|3.3|1 and since v is nondecreasing in 2;, we have 

< v{T, Yt, a) < v{T, x, a) < K{e^^xy a.s. 

from which we deduce by Lemma 4.2 of J6j that 

lim e-^P+^'^^v (T, Yt, a) = 0, a.s. 

T — >+oo 

Hence, by sending T to infinity, we can easily derive the relation (IA.2p . Let (c, Y) be an 
admissible couple such that Itq = ^(o), for a Tq < +00. Assume that Tq is the first time 
when this happens. Then Ys = l{a), and Cg = for every s > Tq. Then for T < Tq we 
get (jA.ip as before. Calling 



It := - e 



-ip+X)s 



dv{s,Ys,a) yfdv{s,Ys,a) 



dx \ dx 



ds. 



we have that It is increasing and from (lA.lj) that there exists its limit for T /" Tq given 
by: 

_e-(p+A)To^ (To, l{a),a) + e~^P+^^'v{t, x,a) - f ° e-(^+^)(^-*) pics) + gis, Ys,a)] ds. 

>Prom the positivity of the integrand in It, we then get that identity (|A.1|) also holds 
in Tq. For T > Tq we can easily derive (jA.ip using the fact that the couple {c,Y) is 
constant after Tq and that (ii) holds. Now, let us focus on the last statement. Let {c,Y) 
he an admissible couple at {t,x). Then {c,Y) is optimal at (t, x) if and only if in (|A.2p 
we have 

r+co 

vit, x,a)= / e-(''+^)(^-*) [Uics) + g{s, Y,, a)] ds. 



ds = 0, 



Jt 
When Yg > l{a), for s >t, this is clearly equivalent to 



+00 



,-{p+X)is-t) 



dv{s,Ys,a) ~ fdv{s,Ys,a 



U{cs)-cs - -' ' -U 



dx \ dx 



I.e. 

-^ f dv{s,Ys,a) \ dv{s,Ys,a) 

Ul j=U[Cs)-Cs ^ , for a.e. s > t. (A.S) 

When Ys > l{a) on (t, T), we have (lATSll on (i, T) and c^ = on [T, +cx)). D 

Now we come to the proof of the Proposition 15.11 First we observe that, thanks to 
Proposition 14.91 the assumptions (i)-(ii)-(iii) of the previous Lemma [A. II hold. So fix 
{t,x,a) G T). First we prove the existence of a solution Y of the problem (15. 3p . The 
dynamics of the system is the function — c(-,-,a) : M+ x {1(a), +00) -^ (0,+oo), with 
(15.1J1 . that is well-defined and continuous as composition of continuous functions on 
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R+ X {1(a), +oo). We note that hypothesis (ii) of Lemma lA. II implies c{t,l{a)^,a) = 0, 
for every t > 0. Hence, we can extend the function c{-,-,a) to a continuous function 
on M+ X (—00, +00) such that c = on R+ x {— 00, l{a)]. Now the Peano's Theorem 
guarantees the existence of a local solution Y. of (|5.3p . We prove that {s,Ys,a) G T) for 
every s >t, i.e. that 

Ys >l{a), for s>t. (A.4) 

If X = l{a), we already know that c{s, l{a)^ , a) = 0, for s > t, given t, so that Yg = l{a), 
for all s > t. 

Now we suppose x > l{a). Since —c{s,y,a) < 0, for each {s,y) £ [t,+oo) x {1(a), +00), 
the solution Y is strictly decreasing on the maximal interval that we denote by {t,T), 
with T > 0. Suppose that there exists an instant t < t' < T such that Yf < l{a). We 
have that dYti = 0. In particular this means that there exists an interval [io)*i] C {t,T) 
with YtQ = l{a) and Yf^ < l{a) such that for all s € {to,ti], Ys < l{a) with dYs{t, x, a) = 0, 
that it is not possible. This proves the claim (IA.4J) . for any x > l{a) and that T = +cxd. 
Now call Cs = c{s,Ys,a) as in (|5.2p . Then the couple {c,Y) is admissible since Cs > 0, 
for every s > t and Ys > l{a) , for s > t. Moreover 

~ / dv - \ _ Ov 

U \—{s,Ys,a)\ = U{cs) -Cs — {s,Ys,a), for a.e. s>t, 

so the couple {c,Y) is optimal at {t,x) thanks to Lemma fA.li Hence the existence of an 
optimal couple for the auxiliary problem is proved. 

Now we prove the uniqueness. Fix a £ A, x > l{a) and t > 0. Let ci, C2 be optimal 
controls at x. Then for i = 1, 2 

roo 



v{t,x,a) = I e-(^+^)(^-*) [U{c,{s))+g{s,Ys''^{c,),a)] ds 
<^+^> [U{c,{s)) + g{s + t, y/(Q), a)] ds, 



t 

+00 







where for every c G Ca{x), Yf{c) = x — f^ c{u)du, s > 0. Since the function U is strictly 
concave, we have by setting c^ = r]Ci + (1 — 77)02, with ry G (0, 1), 

U{c^{s)) = U{r]Ci{s) + (1 - v)c2{s)) > ViU{ci{s)) + (1 - r])U{ci{s)), s > 0. 

Moreover, since Y^{crj) = r]Y^{ci) + (1 — r])Y^ {02), for all s > and g is concave in the 
second variable, we have 

g{s + t,Ys''{crj),a) > ^(s + t,yf (ci), a) + (1 - 7?)5(s + i,y/(c2), a), Vs > 0. 

Then 

/+00 
e-(P+A). [U{c^{s)) + g{s + t, Yf{cr,),a)] ds, 



'0 
that implies the uniqueness of the control of the auxiliary problem. 
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